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Abstract 



This short note proves the (.2 ~ ^1 mstance optimahty of a t\l i\ solver, i.e., a variant of hasis 
pursuit denoising with a £1 fidehty constraint, when apphed to the estimation of sparse (or 
compressible) signals observed by sparsely corrupted compressive measurements. The approach 
simply combines two known results due to Y. Plan, R. Vershynin and E. Candes. 

Conventions: Most of domain dimensions (e.g., M, N) are denoted by capital roman letters. 
Vectors and matrices are associated to bold symbols while lowercase light letters are associated 
to scalar values. The i*^ component of a vector u is Uj or (w)j. The identity matrix is Id. The 
set of indices in is [D] = {!,••• ,D}. Scalar product between two vectors u,v reads 
u*v = {u,v) (using the transposition (•)*). For any p > 1, \\ ■ \\p represents the £p-norm such that 
ll^llp ~ X]j l^jP with \\u\\ = \\u\\2 and ||m||oo = maxj|iij|. The io "norm" is ||ti||o = #suppit, 
where ^ is the cardinality operator and suppu = {i : 7^ 0} C [D]. For S Q [D], G M'^'^ (or 
$5) denotes the vector (resp. the matrix) obtained by retaining the components (resp. columns) 
of w € M.^ (resp. $ G M'^ ^^) belonging to 5 C [D]. The operator T-Lk is the hard thresholding 
operator setting all the coefficients of a vector to but those having the K strongest amplitudes. 
The set of canonical X-sparse signals in is T,k = {v ^ : ||t'||o < K}. B2 and S^~^ are the 
£2 ball and {N — l)-sphere in M^, respectively. Finally, the operator sign A, which equals to 1 if A 
is positive and —1 otherwise, is applied component wise onto vectors. 

1 Introduction 



Let us consider the case where a sparse (or compressible) signal x € is observed with a random 
Gaussian matrix $ ~ Af^'^^{0, 1), 

y = ^x + n, (1) 

with a sparse (or Laplacian) noise n of bounded ^i-power, i.e., there exists a bound e > such that 
||n||i < e with high (and controlled) probability. 
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In this short note, we prove the stabihty of a variant of the basis pursuit denoising program, 
namely 

argmin ||it||i s.t. ||y — < e, (BPDN-£i) 

in estimating x from y under an £i-fidehty constraint. The mathematical tools we are going to 
use are those developed in the recent work of Y. Plan and R. Vershynin in the context of 1-bit 
compressed sensing (l| combined with Candes' simplified proof of basis pursuit denoising £2 — ^1- 
instance optimality No elements are specially new except their combination. In particular, it is 
interesting to see how these two pieces of works fit nicely in order to reach the announced objective. 



2 BPDN-^i instance optimality 



Here is the main result of this note. 



Theorem 1. Let^ G M^^^^ be a sensing matrix used in ([1]) and assume that there exist 3 constants 
^2Ky ^3K £ (0, 1) and ly > such that, for all u E o-'f^d v S with {u, v) = 0, 



lyuu] 



^(sign(*w),*?;) 



< '^2/<||w||, 

< '^SaHI'^II- 



(2) 
(3) 



Then, if 62K + — \, the solution x* of BPDN-li respects 



< 8— + 12eo(i^), 



with eo(i^) = \\x — xkWi/^/K- 



Before to prove this theorem, the following lemma (mainly a rewriting of a result given in [l| 
assures us on the feasibility of the conditions ([2]) and Q. 

Lemma 1. Let N,M,K G N and 6 £ [0, 1]. There exist two constants C,c> such that, for 

M >C5^^K\og{2N/K) (4) 
and $ ~ J\f^^^{0, 1), we have, with a probability at least 1 — 8exp(— cJ^M), 



< S\\u\ 



rf {sign {^u),^v) < 5\\v\ 



(5) 
(6) 



for all u,v £ T,K with {u, v) = 0. 



Proof Let us write /C = S^- n 5^ and /C* = S/^ n S^~\ Using Q, Prop. 4.3] with r = 0, we know 
that there exist two constants C, c > such that if 



M > C5^^K\og{2N/K) 
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and if * = ••• , c^m)'^ ~ AA^^^^(0, 1) with e^,/ G (1 < i < M), then, with probabihty at 
least 1 - 8exp{-c6'^M), 



sup 

aG/C*, b^fC—K 



faib)-Kfa{b) <5, 



where /a(&) := jjJ2j^^S^i{v^ji^)){fjib)- Knowing that E/a(fa) = ^^{a,b), this means that, 
under the same conditions, 



sup 

a£jC*,b£K-K 



^(sign(*a),*fe)- Vf(a,b) 



< 5. 



In particular, for any u,v £ Tik, since w/||w|| G IC* and i'/||i'|| G /C* C /C — /C, we have 
|j^(sign(*u),*ti) - /J||ti|p^(u,i>)| < 
Therefore, if {u,v) = 0, |-^(sign < ^Hi^H, while taking u = v leads to 

|^||*w||i - y^\\u\\\ < 6\\u\\. 

□ 

Remarks on 5: The dependency in in ^ is probably not optimal and could be improved. 
This is actually due to the fact that this lemma is extendable to much more general sets than /C 
(e.g., compressible signals) [ij]. For having only ([5]), 0, Lemma 5.3] shows that a dependency in (5~^ 
is allowed. Moreover, 0] shows that (P holds of M > Mq with Mq = O {S'"^ K log N/K). Proving 
that ([6]) is respected from the same number of measurements is an open problem. 

Proof of Theorem [IJ We follow partially the procedure given in with an adaption due to the 
^i-norm fidelity of BPDN-£i. Let us write x* the solution of BPDN-£i and x* = x + h. In order to 
bound the reconstruction error of BPDN-£i , we have to characterize the behavior of ||a3* — a;|| = \\h\\. 

We define Tq = suppa^i^ and a partition {T^ : 1 < < \{N — K)/K~\} of the support of 
hxg. This partition is determined by ordering elements of h off of the support of xk in decreasing 
absolute value. We have [T^l = K for all A; > 1, n T^/ = for /c / A;', and crucially that 
l^jl ^ l^il for all j G Tfc+i and i G T^. 

We start from 

ll^ll < \\hT,n\\ + WhrgJ, (7) 

with Tqi = TqU Ti, and we are going to bound separately the two terms of the RHS. In Q], it is 
proved that 

WhTsJ < E II^tJI < ||/iToill + 2eo(if), (8) 

k>2 

with eo(i^) = "^II^T^IIi- Therefore, 

ll^ll < 2||^Toill +2eo(i^). (9) 

Let us bound now ||/iToill- We have 

ll*^Toi||i = (sign(*ft.Toi),*^Toi) = (sign(*/iToi),*^) - ^ {sign {^hT,n),^hT J. 

k>2 
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By Holder inequality, 

(sign < < ||$£C — y||i + ||$a; — < 2e. 

For any k > 2, since /itoi and are 2K- and iC-sparse, respectively, with {hToi,hT,.) = 0, we 
know from ([3]) that 

|(sign(*^roi),*^rJ| < M(53x||^tJ|- 

Therefore, using and 

M{u-62K)\\hT,n\\ < ll*^Toil|i < 2e + M63K 

k>2 

<2e + M63K{\\hToA+2eoiK)), 

or equivalently, 

ll^^oill ^ .-iS,K+5s^) iji + '53ifeo(i^)). 

Using ([9]), we find, 

||»,|| <: 4 f_ I A l^+SsK-i'ZK rn(K\ 

ll^ll - U^[&2K+i3K) M y-{i2K+&3K) ^Ol^J- 

Finally, taking (52_ft' + i^s/^ < — ^ provides the result. □ 
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